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Energy efficiency is closely related to the evolution of biological systems and is important to their information 
processing. In this paper, we calculated the excitation probability of a simple model of a bistable biological unit in 
response to pulsatile inputs, and its spontaneous excitation rate due to noise perturbation. Then we analytically 
calculated the mutual information, energy cost, and energy efficiency of an array of these bistable units. We 
found that the optimal number of units could maximize this array’s energy efficiency in encoding pulse inputs, 
which depends on the fixed energy cost. We conclude that demand for energy efficiency in biological systems may 
strongly influence the size of these systems under the pressure of natural selection. 
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The use of the ideas of statistical mechanics to 
study biological systems are nearly as old as this dis¬ 
ciplines itself. Recently, statistical physics has been 
demonstrated as a useful tool to understand the en¬ 
ergy efficiency of biological systems, which measures 
their energy cost for performing specific functions, 
from sensory adaptation in biochemical negative feed¬ 
back loops to information processing in the brain. I 1,2 ! 
It is believed that energy efficiency plays an important 
role in guiding the directions to which the physiology 
and anatomy of biological systems have evolved, and it 
may be related to the basic laws of statistical physics 
in a fundamental way. I 1 ! 

There are many examples of biological systems 
which can operate, in a stable manner, in two dis¬ 
tinct modes. This bistability is a typical way for a 
biological system to transmit information digitally.! 3 ! 
For instance, the initiation of action potentials in neu¬ 
rons follows an “all or none” principle, and an action 
potential is generated only when the system crosses a 
certain threshold.! 4 ! Further examples can be found in 
subcellular signal transduction networks.! 5 1 Since bi¬ 
ological systems are generally subjected to noise, the 
signal processing within a single pathway is potentially 
unreliable. ! 6,7 1 Thus, the multiple pathway is a reason¬ 
able choice to out of this predicament.! 8 ! For example, 
information process in the brain is accomplished by 
a group of neurons working cooperatively, and studies 
have shown that neurons may become synchronized to 


minimize perturbation from noise and thereby facili¬ 
tate reliable information transmission.! 9 ! 

Although transducing information through multi¬ 
ple pathways can improve reliability in the face of 
noise, it can cause a burdensome energy cost to the 
system. For example, the human brain accounts for 
about 20% of an adult’s resting metabolic rate, and 
a large fraction of this energy is used for the genera¬ 
tion of action potentials.I 10 !’! 11 ] Therefore, metabolic 
demands can be large enough to influence the de¬ 
sign, function, and evolution of these biological sys¬ 
tems under the pressure of natural selection through 
evolution,! 12,13 ] so that they might be more energy 
efficient.! 14-15 ] 

Studies have shown that energy efficiency in bio¬ 
logical systems is greatly influenced by physical size. 
Taking neural systems as an example, smaller neu¬ 
rons will cost less energy because fewer ion channels 
are involved and there is less ion exchange through 
ion pumps that drive ATPase Na+/K+ exchangers in 
the recovery from an action potential.! 16 ! However, the 
stochastic nature of ion channel gating creates vari¬ 
ability in the response of neuron to external stimuli, 
and spontaneous action potentials, which reduce the 
reliability of signal processing.! 17 ! In this case, trade¬ 
offs between information transfer and energy use could 
strongly influence the number of ion channels used 
by the neurons. Recent theoretical analysis and com¬ 
puter simulations showed that the energy efficiency 
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could be maximized by the number of ion channels 
in a single neuron, or the number of neurons in a 
network.! 18 !’! 19 ! 

Since bistability is a general mechanism for biolog¬ 
ical information processing, it is interesting to study 
the dependence of energy efficiency on system size 
in this context. In this paper, we first solve a one- 
dimensional bistable Langevin equation, which mim¬ 
ics the switching of a biological system unit between 
a resting and excited state using a particle crossing 
the barrier of a double well potential. Using an ana¬ 
lytical solution for the pulse signal detection rate and 
spontaneous excitation rate, we theoretically calculate 
the mutual information and energy cost of a biologi¬ 
cal unit array to measure its energy efficiency. Lastly, 
we find an optimal number of biological units in this 
array that maximize its energy efficiency. 

The dynamics of our biological model unit is de¬ 
scribed with the following equation: 

x = — u'(x) + r(t), (i) 


where x is the unit’s physiological variable, for exam¬ 
ple, the membrane potential of a neuron. U is a double 
well potential, defined as: 


tt a 2 X 

u= -r + T 


( 2 ) 


U has two minima a; s i = —y/a, x S 2 = y/a and a saddle 
point X /4 =0. T(£) is a Gaussian random variable: 


< r(t) >= 0; < r(£)T(t') >= 2 DS(t - f), ( 3 ) 


where D is noise intensity. 




Figure 1: The detection rate of the bistable unit as 
a function of noise intensity for different input pulse 
strength (a) and its spontaneous excitation rate as a 
function of noise intensity (b). 


The unit is at its resting state when the particle 
is in the left well, and is excited when the particle 
crosses the barrier to the right well due to noise or an 
applied signal perturbation. We assume that the par¬ 
ticle is subjected to a force of short duration, which 
horizontally moves the particle into the region of the 
saddle point. After removing the force, the particle 
drifts up to the region of the saddle point. Near the 
saddle point, the repelling phase trajectories cause the 
particle to accelerate away from the saddle point re¬ 
gion towards one of the two minima. Following Lecar 
and Nossal’s approach of linearizing around the sad¬ 
dle point,! 20 ! we obtained the probability of finding 
the particle in the right well after a long enough time. 

First, we expand Eq. (1) near the threshold singu- 


lar point. Defining 


3. 

1 

II 

(4) 

and since x M = 0, we obtain the equation: 


5 = aS + F (£). 

(5) 

The solution of Eq. (5) is 


5(f) = 5(0)e at + [ e a(t - s) r(s)ds, 

Jo 

(6) 

and the integral equals: 


f e a(t " s) r(s)ds = 5(f) - S(0)e at = X(t). 
Jo 

(7) 

Since T(s) is a Gaussian random variable, the time in¬ 
tegral X(t) also obeys a Gaussian distribution, so we 
have 

P(X,t) = (27t < X 2 >) 2ex P( 9<x2> )’ 

(8) 

We express the expectation value of X 2 in terms of the 
joint expectation of the variable T taken with itself at 
a different time. From Eq. (7) we have 

< X 2 >= —(e 2at — 1). 
a 

(9) 

The unit’s excitation probability under a pulse input 
is equal to the probability that 5(0) > 0 when £ —> oo, 
given an initial displacement, 5(0), then, 

P[5(t) > 0 5(0)] = Urn f™ (0)eat P(X, t)dX 

= *[ 1 + e ^V^’ 

(10) 

where erf(x) is the Gaussian error function, 
has the form 

which 

2 f x 

erf(x ) = —= / exp(— t 2 )dt. 

J o 

(11) 


For simplicity, defining 5(0) = Ax, where Aa; is the 
input strength, we can rewrite the probability that the 
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unit is excited after application of a pulse input (a.k.a. 
the signal detection rate): 

+ ( 12 ) 

Figure 1(a) shows the probability of the unit being 
excited as a function of noise intensity D with different 
input pulse strengths Ax described by Eq. (12). The 
detection rate in response to threshold input(Ax = 0) 
is 0.5 and is independent of noise intensity. The detec¬ 
tion rate in response to subthreshold inputs (Ax < 0) 
increases as the noise intensity increases. This means 
that, with the assistance of noise, the bistable unit 
can detect subthreshold signals, which is a well-known 
result known as stochastic resonance. However, the 
noise sabotages the neuron’s reliability when receiv¬ 
ing suprathreshold inputs (Ax > 0) and the detection 
rate decreases as the noise intensity increases. 

In the absence of inputs, the unit can be excited 
under the perturbation of only noise. This sponta¬ 
neous excitation rate of this bistable unit can be cal¬ 
culated according to Kramers’s formula for escaping 
rate, I 21 ! which is written as 





Figure 2: (a) The biological array is composed of N in¬ 
dependent bistable units; (b) The mutual information 
depends on noise intensity for different array size; (c) 
Mutual information as a function of number of units 
for different noise intensity; (d) Energy cost depends 
on number of units in the array for different noise in¬ 
tensity. 


I< = U"(x s l)\U"(x u )\ exp(-^), (13) 

where A U = U(x u ) — U(x a i). Thus, the spontaneous 
excitation rate of the above bistable unit is 


Ps = 


\/2 a 
27T 


expi ~I5^ 


(14) 


As the noise intensity increases, more threshold¬ 
crossing events may happen due to noise, thus the 
spontaneous excitation rate increases as the noise in¬ 
tensity increases (Fig. 1 (b)). 

Next, we consider a bistable unit array model as 
shown in Fig. 2(a). In this model, each unit in the 
array receives identical pulsatile input, and the out¬ 
put of this array is the composition of the outputs of 
each unit. Assuming the input strength is distributed 
uniformly over the interval [Ax m i n , Ax max ], i.e., its 
probability distribution follows 


Since each unit in the array is independent, the 
conditional probability g(r|Ax) that the output is r 
when the input is Ax is given by a binomial distribu¬ 
tion: 


g(r|Ax) = 


where 


N 

K 


^j(P c (Ax)) K -(l-P c (Ax)) N - K , 

(16) 

is the binomial coefficient and P c {Ax) 


is the probability that a unit is excited after receiv¬ 
ing a pulse input. According to Bayes formula, the 
probability that the output is r can be obtained by 


q{r) = J q(Ax) ■ q(r\Ax)d(Ax) = J q(r\Ax)d(Ax). 

S S 

(17) 

According to Shannon’s information theory, I 22 l the in¬ 
formation between input S and output R is defined as 


q{ Ax) 


Ax max Ax n 


1 

As 


(15) 


Then, x = ( A ^+ A *™*A i s the mean value of input 
strength. In the following calculation, we fix this dis¬ 
tribution interval between [—0.1, 0.1] so that both the 
subthreshold and suprathreshold inputs are involved. 
With the input Ax E S 7 the output of this unit array 
is discrete, i.e., R = {r|r = K/N, K = 0,1,2,..., N}, 
where K is the number of units excited after the in¬ 
puts are applied. 


I m (S\R)= ^2 E <l( A x)q(r\Ax) log 2 q ^ . 

AxeSrGR ’ 

(18) 

In our case of unit arrays, the input is continuous 
and output is discrete, thus the summation need to 
be rewrite as follows: 


Im(S;R ) 


E 

refl 


/ 


q(jnaycausethepagelayouttobeinconsistent 7 hov 


( 19 ) 
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Finally, we obtain 


1 ^ rAx max nirlArl 

Im(S;R) = -r~^2 q(r\Ax) log 2 ——-d(Ax) 

^ S K~o J Aaj min Q\ r ) 

( 20 ) 

Figs. 2(b) and (c) show the dependence of mu¬ 
tual information on noise intensity and the number of 
units, respectively. We note that the mutual infor¬ 
mation exhibits maximal values for moderate value 
of noise intensity. This phenomenon is known as 
suprathreshold stochastic resonance, and the same re¬ 
sults were reported in Ashida and Kubo’s work,! 23 ! 
in which the detection function was obtained by fit¬ 
ting the S-shaped response curves (from simulations 
of a stochastic channel-based model) to an integrated 
Gaussian function. 

For an array of containing N units, the totally en¬ 
ergy expenditure in a time interval At can be written 
as 


E&t = E 0 At + E n (N)At + J d(Ax)q(Ax)E s (N, Ax), 

s 

(21) 

where Eq is the fixed energy cost in unit time, which 
is independent of the number of units in the array. 
The last two terms are related to the energy cost 
due to excitation. For simplicity, we assume the en¬ 
ergy cost of one excitation is 1. E n (N) is the energy 
cost of the spontaneous excitation due to noise in unit 
time, namely E n (N) = NP S . E s (N,t) is the energy 
cost of the excitation in response to input pulses with 
strength Ax and E s (N,t) = NP c (Ax) if the inputs 
are applied in this time interval, else its value is zero. 
Therefore, f d(Ax)q(Ax)E s (N,t) is the average en- 
S 

ergy cost of excitations in response to input pulses 
with distribution q(Ax). Fig. 2(d) shows the depen¬ 
dence of energy cost on the number of units in the 
array. 

Now we consider the energy efficiency of this 
bistable array. After inputs are turned on, the mutual 
information in unit time is I = and the energy 
cost in unit time is E — Therefore, we define 

energy efficiency as 

= J_ = _ Im _ 

^ E E()At + NP s At + J d(Ax)q(Ax)NP c (Ax) ’ 

s 

(22 ) 

which measures how many bits of information are en¬ 
coded by the systems with the consumption of one 
unit of energy. 
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Figure 3: The energy efficiency of the biological unit 
array as a function of unit number for different fixed 
energy Eq. v = 0.1. 

Fig. 3 shows the energy efficiency of the above 
biological array as a function of its size. It is seen 
that as the number of units increases, the energy effi¬ 
ciency first increases and then drops, so that a max¬ 
imum exists. As the fixed energy cost Eq increases, 
the optimal size decreases. When Eg = 0, the max¬ 
imum disappears because the energy efficiency de¬ 
creases monotonously as the array size increases. 

We see that the fixed energy cost is vital for the 
energy efficiency being maximized by the array size. 
Indeed, Schreiber et al ., studied the energy efficiency 
of a group of ion channels transmitting information 
with graded electrical signals. They found that an 
optimum number of channels could maximize energy 
efficiency. The optima depend on the fixed energy cost 
that is related to costs that have to be met in the ab¬ 
sence of signals, such as the synthesis of proteins and 
lipids.! 18 ! Here, in our work, the fixed energy cost is 
essential for the energy efficiency to have a maximum. 
We argue that this fixed energy cost is independent 
of the array size. For instance, this cost could corre¬ 
spond to the energy that downstream systems expend 
to read out the information in the synchronized ex¬ 
citation events, as our previous work on the neural 
systems has showed.! 7 ! 

In conclusion, we have analyzed the energy effi¬ 
ciency of an array of biological units that function ac¬ 
cording to a simple bistable model. We demonstrated 
that the biological array exhibits maximal energy ef¬ 
ficiency with an optimal number of units in the ar¬ 
ray. We interpret this to imply that the demands 
placed on biological systems for energy efficiency un¬ 
der the pressure of natural selection could be strongly 
influenced by their size. This conclusion is consistent 
with previous studies on single neurons and neuronal 
populations.! 18,19 ! Since a bistable model is also often 
used in physical systems for communication systems, 
the principles we have demonstrated here suggest a 
possible way to build more energy efficient communi- 
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cation devices for noisy environments. 


References 

[1] Lan G H, et al 2012 Nat. Phys. 8 422 

[2] Sengupta B, Stemmier M B and Friston K J 2013 PLoS 
Comput. Biol. 9 el003157 

[3] Pomerening J R 2008 Curr. Opin. Biotechnol. 19 381 

[4] Hodgkin A L and Huxley A F 1952 J. Physiol. 117 500 

[5] Ma L et al 2005 PNAS 102 14266 

[6] Pilpel Y 2011 Methods Mol Biol 759 407 

[7] Chen Y, Yu L C and Qin S M 2008 Phys. Rev. E. 78 
051909 

[8] Simpson M L et al 2009 Wiley Interdiscip. Rev. Nanomed. 
N anobiotechnol. 1 214 

[9] Tabareau N, Slotine J J, and Pham Q C 2010 PLoS Com¬ 
put. Biol. 6 el000637 

[10] Richter D 1957 Metabolism of the nervous system. (New 


York: Elsevier) 

[11] Attwell D and Laughlin S B 2001 J. Cereb. Blood Flow 
Metab. 21 1133 

[12] Laughlin S B, van Steveninck R R D R and Anderson J C 
1998 Nature neurosci. 1 36 

[13] Yu Y, Hill A P and McCormick D A 2012 PLoS Comput. 
Biol. 8 el002456 

[14] Niven J E and Laughlin S B 2008 J. Exp. Biol. 211 1792 

[15] Laughlin S B 2001 Curr. Opin. Biotechnol. 11 475 

[16] Niven J E and Farris S M 2012 Curr. Biol. 22 R323 

[17] Chow C C and White J A 1996 Biophys. J. 71 3013 

[18] Schreiber S el at 2002 Neural Comput. 14 1323 

[19] Yu L and Liu L 2014 Phys. Rev. E. 89 032725 

[20] Lecar H and Nossal R 1971 Biophys J. 11 1048 

[21] Gardiner C 2009 Stochastic Methods: A Handbook for the 
Natural and Social Sciences (Berlin: Springer) 

[22] Shannon C E and Weaver W 1948 The mathematical theory 
of communication. (Urbana: University of Illinois Press) 

[23] Ashida G and Kubo M 2010 Physica D: Nonlinear Phe¬ 
nomena. 239 327 


XXXXX-5 



